Quantum Melting of Incommensurate Domain Walls in Two Dimensions 
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Quantum fluctuations of periodic domain-wall arrays in two-dimensional incommensurate states 
at zero temperature are investigated using the elastic theory in the vicinity of the commensurate- 
incommensurate transition point. Both stripe and honeycomb structures of domain walls with short- 
range interactions are considered. It is revealed that the stripes melt and become a stripe liquid 
in a large-wall-spacing (low-density) region due to dislocations created by quantum fluctuations. 
This quantum melting transition is of second order and characterized by the three-dimensional XY 
universality class. Zero-point energies of the stripe and honeycomb structures are calculated. As a 
consequence of these results, phase diagrams of the domain-wall solid and liquid phases in adsorbed 
atoms on graphite are discussed for various domain-wall masses. Quantum melting of stripes in 
the presence of long-range interactions that fall off as power laws is also studied. These results are 
applied to incommensurate domain walls in two-dimensional adsorbed atoms on substrates and in 
doped antiferromagnets, e.g. cuprates and nickelates. 

PACS numbers: 64.70.Rh, 61.44.Fw, 64.70.Dv, 74.20.-z 
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I. INTRODUCTION 

It has been established that a macroscopic num- 
ber of domain walls ( "discommensurations" or "soli- 
ton excitations") appear in incommensutati 
and form a global soliton-lattice structure.Era 
Two-dimensional (2D) solids of adsorbed atoms on 
graphite have been studied as a typical example of 
commensurat p -i pcpn imensurate phase transitions (C-IC 
transitions) BII300 As (2D incommensurate soliton lat- 
tices, theoretical worksB'B proposed stripe and honey- 
comb structups.--.and both of them were observed in 
experimentsEOEj Since domain walls are made from ex- 
cess atoms (for heavy walls), the domain- wall mass can 
be controlled in experiments by changing atoms from 
Xe to 3 He (or H2) and, thereby, quantum fluctuation 
can be increased. Recently, striped anti-phase domain 
walls warp, observed in doped nickel oxides and cupper 
oxides,E-rO in which the stripe structure shows incom- 
mensurate short-range order. The effect of quantum fluc- 
tuations on the 2D domain-wall structures was hence at- 
tracting attention, but in theoretical understanding, lit- 
tle is known about quantum disordered striped or hon- 
eycomb states. Striped domain walls were also found in 
a frustrated 2D quantum spin system that shows magne- 
tization plateaux.E3 

Neutron scattering measurements in the striped in- 
commensurate phases showed that incommensurability ris, 
proportional to the excess density Sn in adsorbed atomstil 
and to Sr concentration aj-4jB-J J a2- a; Sr a ;Cu04 for the un- 
derdoped region, x < 1/8.113113 The nature of one domain 
wall is, hence, unchanged for the whole density region, 
and the domain-wall spacing only changes depending on 
the excess (or hole) density. It was argued for doped an- 
tiferromagnets th at Am i-domain wall behaves like a quan- 
tum elastic string jlall3'E2l In adsorbed atom systems, do- 
main walls are not pinned by the substrate periodic po- 
tential, but floating, and hence we can also adopt this 



string model to describe the single domain wall. 

The stability of domain- wall arrays is controlled by ef- 
fectivejnteractions between walls and fluctuations among 
themulj. When the wall-wall repulsive interactions are 
strong enough, the domain walls form a regular array 
and thereby becomes a solid with incommensurate long- 
range order (LRO). In experiments, this LRO is observed 
as sharp incommensurate Etogg peaks, and in the elas- 
tic theory for domain wallsotj this LRO is characterized 
by finite stiffness. On the other hand, when fluctuations 
are strong, dislocations proliferate and thereby make the 
domain-wall ordering short ranged. In this case, the do- 
main walls are irregular and show a "liquid" -like behav- 
ior with exponential decay of correlations, in which in- 
commensurate scattering peaks have finite width. In the 
elastic theory, this short-range domain- wall order is char- 
acterized by vanishing of stiffness. It was shown that 
thermal fluctuations induce a phase transition from the 
striped or honeycomb (ordered) solid to a short-range- 
ordered liquid at finite temperature and the stripe liq- 
uid phase remains untiLgcro temperature at the onset 
of the C-IC transitionD'EHD Quantum fluctuation was not 
taken into account previously with regard to melting of 
domain- wall structures. 



In the classical theory for domain walls in incom- 
mensurate adsorbed atoms, the wall-wall repulsive in- 
teraction and the wall intersection energy determine t 
ground-state phase diagram of domain-wall structures 
In the stripe structure, walls with spacing I repel each 
other by the exponential interaction!!! aKexp(— kI). Here 
k denotes the inverse of the domain-wall width and 
a = ciQa 2 Y, where c\ denotes a constant of order unity, 
Q the degeneracy of commensurate domains, a the unit 
length of atoms in commensurate domains, and Y the 
microscopic Young's modulus of the adsorbate. At zero 
temperature, the striped domain walls form a regular 
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parallel array with the energy per unit area 



(O-C , OK 

E s = — h — exp(-/cf), 



(1) 



where £o and £ denote the energy and the chemical poten- 
tial of one wall per unit length. On the other hand, ,±he 
honeycomb structure has the wall-intersection energycl f\ 
per intersection. The total energy of a regular honeycomb 
domain walls per unit area is 
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where / is the length of one side of the unit hexagon. For 
each structure, the length I is determined by minimizing 
the energy with fixed £■ The ground-state structure is 
selected by comparing the energies with determined Vs. 
When the intersection energy fi is positive, the stripe 
array is more stable than the honeycomb structure for 
large wall-spacing I due to absence of the intersection 
energy, whereas the honeycomb structure is favored for 
moderate I due to rapid decay of the wall-wall interaction. 
If the intersection energy is negative, only honeycomb 
states appear in the whole density region!] 

In this paper, we study quantum fluctuations in 
domain-wall structures taking account of spontaneous 
creation of dislocations at zero temperature. We use an 
elastic theory to discuss striped domain walls or hon- 
eycomb ones. Considering the effect of dislocations in 
the 2+1D space, we discuss a quantum-melting transi- 
tion of the stripe structure, which occurs as a conse- 
quence of the proliferation of dislocations. It is shown 
that, for a large- wall-spacing region, the striped struc- 
ture with short-range wall-wall interactions is unstable 
against quantum fluctuations and becomes a stripe liq- 
uid even at zero temperature. This melting transition is 
a continuous one in the universality class of the three- 
dimensional (3D) XY model. We point out that this 
quantum disordered stripe phase was presumably ob- 
served in neutron scattering experiments of adsorbed H2 
or D2 monolayer on graphite,E!J and in those of doped 
cupper oxides and nickel oxides. liEO For 2D adsorbed 
atoms, our results indicate that when the wall intersec- 
tion energy f\ is positive, the stripe-liquid phase appears 
between the commensurate and stripe-ordered phases. 
The zero-point energies are also estimated for both stripe 
and honeycomb structures, and finally possible phase di- 
agrams for incommensurate 2D atoms on surfaces are 
given for various strength of quantum fluctuations. For 
convenience of readers, we show the phase diagrams ob- 
tained in this paper in Fig. [l] in advance. The inverse of 
the domain- wall mass 1/m and the excess density 5n are 
taken as variables. The parameter 1/m represents the 
strength of quantum fluctuations and the limit 1 /to — > 
corresponds to the classical limit. A phase separation 
occurs in a certain density region between the stripe 
phases and the honeycomb one. On the other hand, if 
stripes have long-range wall-wall interactions that fall off 
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FIG. 1: Schematic phase diagrams of incommensurate phases 
in 2D adsorbed atoms on substrates. The wall-intersection 
energy is set to be positive but not very large and the domain- 
wall width k _1 (a) fixed and (b) m-dependent. (See text in 
Sec. |^.) The phase transition between the stripe liquid phase 
and the stripe ordered one is of second order. In the shaded 
regions, the phase separation (PS) occurs between the stripe 
phases and the honeycomb one. 



as power laws r~ q+1 with q < 5, the stripe structure is 
stable in low density and unstable in high density. This 
tendency to ordering is, thus, opposite to the case of 
short-range interaction systems. 

We discuss the stripe structure with short-range in- 
teractions in section |ll] and the honeycomb structure in 
section [II, Phase diagrams for adsorbed atoms on sub- 
strates are proposed in section [V . In section [v| we dis- 
cuss stripes with long-range interactions that fall off as 
power laws. Section VI contains discussions. 



II. STRIPED DOMAIN WALLS 

In this section, we discuss quantum fluctuation of 
stripes and show how a quantum stripe liquid appears. 
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Hamiltonian of quantum stripes with 
dislocations 



Let us consider first the long-wavelength fluctuations 
of stripes which do not contain any dislocation. For sim- 
plicity, we consider striped domain walls on a rectangular 
substrate, which are aligned alo ng , . the sj- axis. It was ar- 
gued for doped antiferromagnetsll§t§cJ that a single do- 
main wall behaves as a quantum elastic string with the 
wall mass m per unit length and the interfacial stiffness 
7. In adsorbed atom systems, domain walls are float- 
ing and hence this string model can be also adopted. 
Here the mass m relates to the mass of adsorbed atoms, 
and the stiffness 7 comes from both the line tension of 
the walls and the anisotropy of substrates. In a stripe 
pattern, domain walls interact with each other by both 
the exponential repulsion and hard-core potential, and 
hence stiffness K x appears between walls. In the contin- 
uum limit of the displacement field, the Hamiltonian for 
stripes without any dislocation has the formed 



Ho = \J d 2 rS^ + l(d y u) 2 + K x (d x u) 2 ^ 



(3) 



up to quadratic terms, where u denotes the x displace- 
ment of the wall from the straight position and p is the 
conjugate momentum. A path integral representation 
leads to Z = / Z>u(t, r) exp(— So) with the effective ac- 
tion 



S [u] = ±J drd 2 r 2 K a {d a u) 



(4) 



a—r,x,y 



where K T — m/l and K y = j/l. The functional integral 
has ultra-violet (UV) momentum cutoffs \q T \ < ire/a, 
\lx\ < n/Ql, and \q y \ < ir/a, where c = ^/7/m, and Q 
denotes the degeneracy of commensurate ground states. 
With rescaling T = ct, X = (j/IK^^x, and Y = y, 
we have the isotropic effective action 



Sq\u] 



K 
2ti 



dTd 2 R 



E 

a— T,x,y 



{d a uf 



(5) 



with K = {mK x /l) 1 / 2 . 

Equation (|^) is not the full Hamiltonian, since real 
stripes have dislocations (defects) even at zero temper- 
ature owing to quantum fluctuations. Hence we next 
take into account the singular part in u that comes from 
dislocations. The dislocations become lines (or loops) 
in the 2+1D space as shown in Fig. [2| Q domain walls 
merge together into a dislocation so that each dislocation 
is consistent with the domain strHGtwe. The strength of 
dislocation lines can be observed23'Eil by a loop integral 
over derivative of the displacement field on a closed loop 

r 



du = Qls, 



(6) 




FIG. 2: Dislocation line of stripes in the 2+1D space when 
the commensurate domains are doubly degenerate (Q — 2). 
Two types of commensurate domains are labelled with A and 
B. 



where s (= 0, ±1, ±2, • • •) denotes the number of dis- 
location lines enclosed by the loop T. The field u can 
be divided into the smooth part w sm ooth and the singular 
part w s ing that describes dislocation lines. Thus Fourier 



transform of the gradient of u can be written as 
»qusmooth(q) + iQH x n(q)/g 2 



(7) 



in the continuum limit, where q = {qxilyilr) and n(q) 
denotes Fourier transform of dislocation density vectors. 
Inserting eq. (0) into the gradient ^vector V« in eq. (jjj), 
we obtain the total effective actioncij 



S = SoKmooth] + Sb[n] 



with 



1 f d?q {QlfK 



(2-) 3 



n(q)| 2 



(8) 



(9) 



B. Criterion for quantum melting 

After transforming the displacement field as u = 
2iru/Ql, the system has periodicity 2-7T. By rescaling 
f = ct, i = ax/Ql and y — y, the effective action is 



u) 2 



(10) 



with the couplings 



K T = K y = Q(Ql) 2 v^/(2ir) 2 a, 
K x = (Ql)K x /(27r) 2 ca, 



(11) 



where cutoffs are set as Af = Ax — Ay = a. In these 
notations, dislocations are quantized as 



du = 2tts. 



(12) 



The final forms ([!(]) and ( |l2j ) are equivalent to a spa- 
tially anisotropic 3D XY model in the vortex loop 
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representation 



Regarding the displacement field as 



the phase 9(r) — 2iru(r)/Ql, we thus mapped disloca- 
tions of stripes onto vortices of phases, and the 2D quan- 
tum stripe system onto the anisotropic 3D XY model 
with couplings 2aK Tl 2aK x and 2aK y . 

In the absence of dislocation lines, the Hamiltonian (Q) 
has only quadratic terms, and consequently, the stripes 
have finite stiffness at any value of parameters / and m. 
ZaanenEHl argued that dislocations cannot proliferate in 
quantum stripes at zero temperature, but we disagree 
with his points. His argument about dislocations is based 
on a classical picture of Kosterlitz-Thouless transitioned 
and can be applied only to classical striped systems. 
Since the quantum system is mapped onto a 2+ ID one 
at finite temperature, gain of quantum entropy can over- 
come loss of the core energy of dislocations in a specific 
parameter region. In 3D superfttud, which is equivalent 
to the 3D XY model, FeynmanEH proposed that vortex 
loops are responsible for transition. Then it was dis- 
cussed that dislocation loops reduce superfluidity to zero 
at the critical temperatureoo This picture was coiu. 
firmed by Monte Carlo simulations of the 3D XY modelES 
and the critical exponent v = 0.67 was correctly de- 
rived |fcpm a renormalization-group treatment of vortex 
loopsE3 

For the mapped 3D XY model, we know that there are 
ordered and disordered phases in the parameter space of 
K T , K y , and K T . It is natural to expect that the critical 
point is given by the relation 



(K x K y K T 



C 



(13) 



with a constant C of order unity, and long-range or- 
der exists for (KxKyKr) 1 ' 3 ?^ 1 > C. Due to the pres- 
ence of dislocation lines, the stiffness of stripes is re- 
duced and the quantum disordered phase appears in 
(K x K y K T ) x l z hr 1 < C. This melting is a continuous 
transition in the same universality class as the 3D XY 
model. In the stripe-liquid phase, the correlation length 
shows the forrrO 



£ ~ (n c - n) " 



(14) 



with v ps 0.67 near the critical density n c . Though there 
are Q degenerate ground states for each stripe configu- 
ration, they can be changed from one to others by rep- 
etition of transformation u — > u + a and hence may not 
affect properties of the phase transition. 



C. Phase diagram 

To proceed with calculation of the phase diagram, we 
need parameter dependence of K x . Here, we derive the 
form of K x with various approximations and thereby ob- 
tain the phase diagram of the stripe liquid and ordered 
phases. 

In the large-m limit, the wall fluctuation is negligible 
and the exponential repulsion dominates the stiffness 



When the mass m is finite, but large enough, the wall 
fluctuation slightly modifies the effective repulsion form. 
Since the quantum elastic string is equivalent to a 3D 
classical Gaussian surface in the path-integral picture, 
we can use results derived for the 3D Gaussian sjiriace. 
From the renormalization-gmup (RG) argumentsEilt3 in 
a mean-field approximation,E3 the stiffness is derived in 
the form 



K x — ctK I exp 



2kI 



for lo < 2 with the dimensionless parameter 

Hk 2 



(16) 



(17) 



which represents strength of quantum effects. 

On the other hand, if the quantum wall-fluctuation is 
large, i.e. ii)>l, the hard-core repulsion becomes im- 
portant, producing steric force between walls.H For the 
mean-field arguments, in which one surface is confined 
in a limited space between perfectly plane two walls with 
distance 21, a rigorous proof shows thaJLthe effective en- 
tropic repulsion decays exponentially.E-3 From rescaling 
vf = u/l and r' = ct, it comes out that the dimensionless 
parameter of surface configuration is hj '{I 2 \Jrrvf). We, 
hence, conclude that K x depends on I for large / in the 
form 



K x ~ exp{— c 2 (m7) 1 ' /4 //v / ft}, 



(18) 



where c 2 is a positive constant. This is-consistent with 
the form derived from RG argumentsO (see also Ap- 
pendix A) 




11/8 



;3/4 



exp 



kI 



(19) 



K x = aK 3 lexp(—K,l). 



(15) 



which is valid for u; > 2. Note that the above reswlt is 
derived in a kind of "mean-field" approximation.^ Re- 
cently Zaanencj treated fluctuations of many walls in the 
harmonic approximation and estimated the stiffness-be- 
tween walls from Helflich's self-consistent condition.Ej In 
the large-Z limit, his result shows the stretched exponen- 
tial form K x ~ exp{— C3( v /ro7/?i) 1 / 3 / 2 / 3 }, where C3 is a 
positive constant. It might be unclear whether his argu- 
ment gives the exact result at the delicate dimensionality 
(d = 2), where the Gaussian surface is in the upper criti- 
cal dimension D (= d + 1) = 3. In the moderate distance 
I, however, the self-consistent condition gives the same 
exponential form as eq. jis|). Since the difference be- 
tween the simple exponential and stretched exponential 
forms appears only in an extremely large-spacing region, 
we use the simple exponential one in the following dis- 
cussions. 

The large m and small m regions in which the original 
exponential repulsion and the hard-core one dominate, 
respectively, can be defined from the behavior of the de- 
viation Au of the displacement. Using the mean-field 
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approximation^! and applying the harmonic approxima- 
tion to the potential created by exponential repulsions 
between adjoining walls, we have the Hamiltonian of a 
single wall 



H 



dy 



P 



M 2 u 2 



(20) 



with M 2 = 2an 3 exp(— nl). The deviation of u in the 
harmonic approximation is estimated as 



[(Auf 



he 



log 



7T 2 7 

a 2 M 2 



L0l 



(21) 



for large I. On the other hand, if the quantum string wan- 
ders a lot and repels from the adjoining straightiines by 
the hard-core repulsion, the deviation is provecO to be 
(Au) 2 ~ I. Since the deviation (Ait) 2 has length dimen- 
sion as I 2 , it should be scaled as (Aw) 2 = l 2 F(h/l 2 yfmrj). 
To incorporate the I dependence for large Z, we set 
F(x) ~ yfx. The quantum wall with hard-core repul- 
sion, thus, has the deviation 



[(A«) 2 ] h . c 



(22) 



By comparison with [(Au) 2 ]h. a . and [(Au) 2 ]h. c ., it is clear 
that, for uj -C 1, the deviation of the wall in the har- 
monic potential is small enough and the hard-core re- 
pulsion does not work, i.e., the wall is controlled by the 
exponential repulsion, while for oj 3> 1 the hard-core re- 
pulsion controls the wall wandering and the steric inter- 
action works. This result is copjistcnt with that from RG 
treatments in the large I limit ,Eilti3 where the relevant in- 
teraction changes from the exponential one [eq. (fuf)] to 
the hard-core one [eq. (|l^)] at lu — 2. This change of 
dominant interactions is a crossover for moderate /. 
Here we start discussion of the phase diagram. In sec. 



[IB, we showed that stripes become short-range ordered 
in (KxKyKrY^hT 1 < C, where C is a constant of order 
unity. Inserting eqs. (JTT|) , (16), and ( [l9| ) into this crite- 
rion, we conclude that the stripes melt for large l(> l c ) 
and become a short-range ordered state, i.e., a stripe liq- 
uid. (Though this equation is satisfied by two values of l c , 
this equation is asymptotically correct in the large I limit 
and hence large l c is the physically meaningful one.) We 
expect that this conclusion does not rely on the approx- 
imation method we employed. Even if the steric force 
decays in a stretched exponential form, this statement 
still holds. The phase diagram of the stripe solid and 
liquid phases is shown in Fig. [| for various mass m. In 
the large-mass limit, which corresponds to the classical 
system, there is no liquid phase. For large m, the critical 
length at the melting transition is 



lr 



1 . Q ? Vim 3/2 

— log 5— = 

K ah 3 K 5 



(23) 



and it rapidly shrinks with reducing the mass m. Due 
to a crossover of interactions from the exponential one 
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FIG. 3: Possible phase diagram of stripes. The dotted line 
and dashed one denote asymptotic forms of the phase bound- 
ary for small m [eq. (124)] and large m [eq. Q23)] , respectively. 



to the steric one, the critical length turns to increase for 
small m, satisfying 



log 



?V /4 



247m) 1 / 4 6 am 1 '*!?' 2 * 33 / 



16 ' 



(24) 



The phase boundary, thus, shows reentrant behavior with 
changing the parameter 1/m. 

From the above calculations, we also obtain the zero- 
point energy of striped domain walls described by the 
Hamiltonian (||). Using eqs. ( p^ ) and (|l9|), the zerorfioint 
energy of stripes per area is estimated as followsEa (see 
appendix A): For small m, i.e., 



AE K 



Co 
I 



C4V7 , 
" al 5 ' 4 ' 



5/8 



1/2 



exp 



(25) 

where Co denotes the zero-point energy of one wall per 
length given by Co = (hir/4a )y/j/m and C4 is a positive 
constant, and for large m, i.e., to -C 1, 




exp 



2nl 



(26) 



In this approximation, the C-IC transition is of second 
order and the chemical potential dependence of the ex- 
cess density is Sn ~ \/l ~ [— log(C — Co)] -1 for any m. 
If the stretched exponential form is adopted as the steric 
interaction, Sn ~ [— log(C — Co)]~ 3 ' 2 f° r small m. This 
critical behavior may be modified if dislocations of stripes 
are taken into account. In an exactly jSolvable 2D classi- 
cal domain- wall model, BhattacharjeeLJ showed that dis- 
locations can induce a crossover and change the nature of 
the C-IC transition. This problem will not be discussed 
further in this paper. 
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D. Comparison with experiments 



intersections) obeys the Hamiltonian 



The present argument on quantum melting of stripes 
are rather general and hence can be applied to various 2D 
systems that have incommensurate stripe structures, e.g., 
adsorbed atoms on graphite and doped high-T c cuprates. 
Comparing with experiments done for various adsorbed 
atoms, we realize that quantum melting of stripes seems 
to have been already observed in scattering experiments 
of H2/Gr and D2/GrJ 2 il where the correlation length 
shows a sudden decrease in a finite density region just 
above the commensurate density, though this region has 
not been regarded as the stripe liquid phase previously. 

We can also find a signal for melting of the stripe struc- 
ture in scattering experimentstSO on L^-^Sr^CuO^, 
where the width of incommensurate peaks becomes larger 
with lowering the hole density in x < 1/8. To understand 
the Sr-concentration dependence of the peak width, we 
might need to take into account the strength and form 
of interactions more carefully. The case of power-decay 
interactions is discussed in Sec. [v|. It should be noted 
that effects of randomness ace important in some experi- 
ments. Bogner and ScheidEZI discussed that randomness 
can also make stripes short-range ordered for any wall 
spacing. 



III. HONEYCOMB PHASE 

In this section we discuss quantum fluctuations of the 
honeycomb structure. First, we consider local lattice vi- 
brations. Since each straight line has finite length I in 
hexagons, the zero-point energy of one domain wall has 
a finite-size correction 




(27) 



There are also so-called "breathing modes" J] in which the 
classical energy except interactions does not change with 
enlarging one hexagon. In quantum mechanics, this de- 
gree of freedom creates a zero-point oscillation and hence 
increases the energy. If the mass m is large and the devi- 
ation of u is very small, the potential from the adjoining 
parallel walls can be well approximated by a quadratic 
form and in the absence of meandering of walls, breath- 
ing of one hexagon behaves as a harmonic oscillator. The 
zero-point energy per cell is thus roughly estimated in the 
exponential decay form exp(— \/3kI/2) for large m. On 
the other hand, the hard-core repulsion is dominant for 
small m. In the harmonic approximation the problem is 
reduced to a quantum particle in the square well infinite 
potential and the energy decays as 1 /(ml 3 ) per cell. 

Global lattice vibrations of the honeycomb structure 
can be treated with a continuum elastic theory, in which 
the displacement vector u = (u x , u y ) of domain walls (or 



1 



f Vsi 



11 2 J \ 2m~ P + f {diUj + djUiY + A(V • u) 2 



+V(V x uf 



(28) 



UV cutoffs of the vibrations are set as Ax = Ay = Ql. 
The time cutoff for the longitudinal mode is given by 
At = ajc\ with c 2 — \/3l(/i + A/2)/m, and for the trans- 
verse mode At = a/ct with c 2 = \/5l(ii + r y')/2m. The 
Lame coefficient 7' can be estimated as 7' = 2j/V3l from 
the anisotropy of the substrate, where 7 is the same in- 
terfacial stiffness as in stripes. Other coefficients /i and 
A are determined from the similar procedure as that for 
the stripe structure. 

In the large-m limit, the Lame coefficients fi and A are 
determined by the exponential repulsion in the form 



2^ + A~ (54aK 3 /ir 2 )l 3 exp 



(29) 



For small m, the hard-core repulsion between walls (and 
intersections) creates a steric force. To estimate Lame co- 
efficients ^i|-apd A due to this steric force, we extend Hel- 
frich's ideaE3 to this problem: We made a self-consistent 
condition 



,d 2 Ae{^\) 
dl 2 



= 4( M +A), 



(30) 



where Ae(/i, A) = e(/i, A, 7 
denotes the energy of eq. (C 



) — e(0, 0,7') and e(fi,X,j') 
|) given by 



e(Ai,A,7') 



Hn 2 



2m 



m 



121 3 V 
hir 2 /v / 3(2/x + X)l 



121 3 V 

Under the assumption fi — bX, eq. 
form 



2m 



(31) 



J) is solved in the 



/' 



bX 



35tt 5 \ 2 %/3&(&+ 1/2) h 2 
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(b+iy 



ml" 



(32) 



where the ratio b cannot be determined. This form im- 
plies that the wall-wall (or intersection-intersection) in- 
teraction effectively decays in the power decay form l/l 3 . 
From these Lame coefficients, and using eqs. (|7|) and 
d3l|), the zero-point energy is estimated. For large I, the 
leading order term of the energy from the global modes is 
more dominant than the one that comes from the breath- 
ing mode for any m. The breathing oscillation, thus, 
gives a soft mode at T = 0. The most dominant term of 
the zero-point energy is 



AE h 



2ACo(0 tm 2 



(33) 



7 



for any m (< oo), i.e. regardless of forms of the dominant 
interaction. The second term can be considered as the 
zero-point energy of torsion vibrations of hexagons. 

This system has two components (u x ,u y ) in xy plane 
and hence has similar degrees of freedom as vortex melt- 
ing problems in 3D superconductors at finite tempera- 
ture, in which it has been argued that the transition is 
of first order.E3c3 We, hence, expect that the quantum 
melting of the honeycomb structure at T = is also of 
first order and one cannot reach a critical region. Nev- 
ertheless it is instructive to derive the phase boundary 
assuming a second-order transition. In the 2D melting, 
problem, the leading-order term of the bare stiffnesa3'c£l 
is given by (QZ) 2 ^[(/x + \)/(2(i + A) + 1] and that be- 
comes (Ql) 2 [i in the strong anisotropy limit whatever 6 
is. The most dominant stiffness, thus, comes from /i in 
the 2D plain. In the 2+1D system, after the rescaling 
x' = ax/Ql, y' = ay/Ql, u' = 2nu/Ql, and r' = c t ar/Ql 
for the transverse mode and r' = c\ar/Ql for the longi- 
tudinal one, the effective action has the bare stiffness 

K\ = Q 2 lmci/V3(2ir) 2 (34) 

for the longitudinal mode, and 

K t = Q 2 lmc t /v / 3(2n) 2 (35) 

for the transverse one. We expect that, even in the 2+1D 
system, the most dominant contribution to the stiffness 
in xy plane comes from [i and the effective coupling con- 
stant is presumably given by 

K w Q 2 l x /h^l/3 1/4 (2Tr) 2 ~ hQ 2 /l (36) 

in the strong anisotropy limit (/i, A -C 7'). This indicates 
that the honeycomb structure is unstable for K/h < C 
with a constant C of order unity, and hence it melts for 
large I region. 

IV. PHASE DIAGRAMS FOR ADSORBED 
ATOMS 

From the above arguments, we obtain phase-diagrams 
for incommensurate phases of adsorbed atoms.cil A phase 
diagram with the parameters m" 1 and Sn was shown in 
Fig. ^](a) for a positive but not very large intersection 
energy f\. Various phase diagrams can appear depending 
on the intersection energy fi, which is determined by 
microscopic atomic configurations around intersections. 

The stripe liquid phase exists for any mass in the vicin- 
ity of the onset of the C-IC transition and no direct 
transition can occur from the commensurate phase to 
the stripe ordered one. Actually this stripe liquid phase 
was presumably observed in H2 and D2 on graphite,EU as 
already mentioned in Sec. |0]D. The phase boundary be- 
tween the stripe liquid and stripe (ordered) solid phases 
shows a second-order transition in the 3D XY univer- 
sality class. The phase boundary shows a reentrant be- 
havior because of the crossover of dominant interactions 



around u> ~ 2 as discussed in Sec |l]C. The crossover 
mass can be roughly estimated from to c = 2. For this 
purpose, we use the-value of the domain-wall width 
estimated by Villairo as k" 1 = 5a for 3 He monolayer on 
graphite. The stiffness 7 comes from the domain- wall en- 
ergy and it should be of the same order as the melting 
temperature of the commensurate phase. We hence set 
a-f ~ a few [K] and then roughly estimate that the cross- 
over mass (am c « afi. 2 K 4 /4(47r) 2 7) is about 10 -4 [atomic 
mass unit] in monolayer on graphite. We note that this 
value can vary greatly by changing the substrate poten- 
tial. 

If the intersection energy f\ is not very large, this 
melting line merges into the phase boundary between 
the stripe and honeycomb phases. Because the tran- 
sition from the stripe phase to the honeycomb one is 
of first order, the system shows a phase separation, in 
which two phases coexist, for a certain density region 
(the shaded ones in Fig. |l|). From comparison of the 
zero-point energies of two phases, this phase boundary 
slightly moves to higher density region with lightening 
the mass. Moreover, in the small-mass limit, commensu- 
rate domains themselves would melt and become a con- 
ventional isotropic liquid. This isotropic liquid phase is 
also taken into account in Fig. |l|. 

Another quantum correction might appear in the width 
kT 1 of domain walls. Halpin-Healy and Kardeitl ar- 
gued that, in light atoms, the commensurate solid is 
more compressible due to quantum fluctuations and the 
width becomes small, whereas, in heavy atoms, the 
width k™ 1 is large. This is consistent with the estimates 
from experiments, whera— the width was estimated a& 
ps 0.8a for D2 systems 21 ] and 1=3 5.7a for Kr systems.c2l 
In real adsorbed systems, it is hence likely that due to 
m-dependence in n~ l the honeycomb phase is favored for 
heavy atoms and the stripe phase for light atoms [see Fig. 
0(b)]. 



V. STRIPES WITH LONG-RANGE 
INTERACTIONS 

In this section we consider the case that stripes are re- 
pelling with each other by long-range interactions with a 
power-decay form. For example, in doped antifcrromag- 
nets, if holes are perfectly doped only in domain walls 
and domains are insulating, there must be Coulomb long- 
range repulsion between hole-rich domain walls. 

Let us consider the power-decay interaction V(u) = 
ciu~ q+1 between walls, where c\ is a positive constant. 
(Coulomb repulsion between lines corresponds to q = 1, 
i.e. V(u) = — In it.) In the case of Coulomb repulsion, 
however, the plasma modes uj p ~ \fk^ appear and low- 
lying excitations in fc^-direction does not have fc-linear 
spectrum. The plasma modes appear for the long-range 
interactions r~ q+1 with q < 2 (see Appendix B). Hence 
for stripes with q < 2, the stiffness K x diverges and 
the elastic theory with the Hamiltonian d3|) cannot be 
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excess density bn ~ l/l 

FIG. 4: Phase diagram of the stripe structure with long-range 
interaction r~ q with 2 < q < 5. 



applied. Hereafter, we consider only the case q > 2 
and use the melting criterion derived in sec. |JB. The 
renormalization-group equationcH shows that power-law 
repulsions are not modified by the entoropical force from 
the hard-core repulsion. The stiffness K x of the Hamil- 
tonian (||) is hence given by 



c 2 r q 



(37) 



with C2 > for any parameter lo. After the rescaling u = 
2iru/Ql, t — ct, and x — ax/Ql, we have the effective 
coupling 



K x = 



Qac2 

47T 2 d 9 ~ 1 



(38) 



for the effective action (p-Op. 

Inserting eq. (^) into eq. ( |l3| ) , we find that the critical 
point l c satisfies 



(KzKyKr) 1 / 3 



hr 1 



(-2 



1/3 



C, 



(39) 



where C is a positive constant of order unity. From the 
melting criterion, we thus find that stripes with 2 < q < 5 
melt for small- wall-spacing (high-density) region and sta- 
bilize for large-wall-spacing (low-density) region because 
of long-range repulsion. Note that this behavior is con- 
trary to the short-range case. A phase diagram is shown 
in Fig. This tendency to solidification in low-density 
region is similar to that of charged point objects, e.g. 
Wigner crystals, and may be universal in systems with 
Coulomb repulsion. On the other hand, for q > 5 the 
tendency to striped ordering is the same as the short- 
range interaction system and stripes become a liquid for 
low-density region. 



VI. DISCUSSIONS 

To summarize, we studied the effect of quantum fluc- 
tuations on 2D domain walls and showed a quantum- 
melting behavior. We found that striped domain walls 
with short-range interactions become a stripe liquid even 
at zero temperature in the incommensurate phase in the 
vicinity of the onset of C-IC transition. We discussed 
both short-range and long-range interactions that decay 
in power laws. It was revealed that striped correlation 
is enhanced in high density for the case of short-range 
interactions and in low density for the case of long-range 
interactions. Though we employed various approxima- 
tions in estimating the stiffness K x , we believe that the 
above qualitative conclusion does not drastically depend 
on the choice of approximations. 

We discussed mass dependence of domain-wall struc- 
tures in adsorbed atoms and obtained phase diagrams as 
shown in Fig. [I]. For this purpose, we assumed that the 
intersection energy is positive. Recently Morishita and 
TakagicS performed path-integral Monte Carlo simula- 
tions for 3 He on graphite. Their result is consistent with 
the positive intersection energy. They also proposed a 
honeycomb-cage structure where commensurate regions 
and discommensurate ones are r©pposite to the honey- 
comb incommensurate structured Direct STM measure- 
ments of 3 He atoms in the incommensurate phase are 
desired to clarify the real structure.c3 As we commented 
in Sec. IV, the quantum correction to the domain- wall 
width k may be also important to reproduce precise 
phase diagrams of incommensurate adsorbed atoms on 
graphite. Evaluation of m dependence of k remains to 
be considered. 

In a doped Mott insulator, Kivelson et alEi discussed 
appearance of electronic nematic and smectic phases 
from an analogy of classical liquid crystals. From the 
symmetry, the stripe liquid we discussed is characterized 
as a nematic state. Our arguments thus demonstrated 
appearance of a quantum nematic state at T = for 
low-density region and the correlation length to be finite 
until zero temperature even in pure systems. A quantum 
transition from the electronic nematic phase to isotropic 
Fermi liquid was also discussed by Oganesyan et alEi 

Finally, we comment implication of our results on 
the doping dependence of tiiG-incommensurate order ob- 
served in La2- K Sr :r Cu04Jia , tZl Since incommensurabil- 
ity is proportional to Sr concentration x in the region 
x < 1/8, our domain- wall model can be applied in this re- 
gion. The system is in the insulating spin-glass phase for 
x < 0.055 and the superconducting phase for x > 0.055. 
The correlation length gradually decreases with increas- 
ing Sr-concentration x from x ~ 0.024 and after the sys- 
tem enters into the superconducting phase the correlation 
length turns to increase. If we assume that antiferromag- 
netic domains are insulating in the spin-glass phase and 
metallic in the superconducting one (above T c ), the wall- 
wall interaction would show the power-decay and expo- 
nential ones, respectively. Under this assumption, the 
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hole-density dependence of the correlation length can be 
naturally understood from the present results. More pre- 
cisely, in Coulomb repulsive systems the stiffness K x is 
infinite in pure systems due to plasma modes and ran- 
domness would be relevant to make the correlation length 
finiteEH. Another possibility would be that, antiferro- 
magnetic domains are always insulating for x < 1/8 and 
there is power-decay force between stripes. In that case, 
to understand enhancement of the correlation length in 
0.055 < x < 1/8, we may need to consider that the 
wall-wall interaction is enhanced in the superconducting 
phase due to coupling with fluctuations of superconduc- 
tivity. This is a current hot topic, but out of scope of the 
present paper. 



the calculation. Instead of using the external potential 
used in Ref. |3^, we consider a valley potential 

A, \x\>l, 
V(x) = { Bexp{- K (x + l)} 

+ £>cxp{— n(l — x)}, \x\ < I, 

( A1 ) 

where the spacing I between the string and walls is fixed 
in advance. Rescaling the imaginary time r as cr with 
c = y/~f/m, we have the isotropic effective action for one 
quantum string in the potential 



dTdy{(d T u) 2 + (d y u) 2 + T^iu)}. (A2) 
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APPENDIX A: RENORMALIZATION-GROUP 
TREATMENT OF A STRING BETWEEN FLAT 
WALLS 

Using the functional rezuprmalization-group treatment 
given by Fisher and HuseJ£3 we reexamine the calculation 
of effective potential between a quantum string and a flat 
wall given in Ref. B3. For completeness, we briefly show 



Integrating out fast modes in string fluctuation up to UV 
cutoff At = Ay = £, we obtain the renormalized action 

S R = ^ J dtdy{(d T u) 2 + {{L U f +7 -1 V£(u)} (A3) 
with the renormalized potentialEll 

1 



/2n6(l*) 



du'V{v!) exp 



(u - u'f 
25 2 {l*) 



_ (A4) 
where 5(1*) — HI* / 'tt y/fnq and.1^ = log(£/a). The corre- 
lation length is determined bytil 



d 2 V s (i 



du 2 



u=0 



1_ 



(A5) 



One can evaluate the renormalized potential using the 
steepest-decent method in the large-/ limit. For uj (= 
hK 2 /iiry/frPf) > 2, 



V 6 (u) = 




7r \k(1 — u) 21*lo — k(1 — u) 

I 



exp 



exp 



4Pw 



K 2 



{l + uf 



[l-uf 



(A6) 



The condition (A5) gives the correlation length in the 
leading order 



sition u = 



1/8 



nl 



exp 



2V2w 



(A7) 



A /2« 3 7 2 



1/4 



u=0 \ w 3 / 2 / 



exp 



I, (A8) 



and the renormalized potential at the equilibrium po- 



where the exponents of the power forms in eqs. ( A7) and 
( [A 8] ) are different from those in Ref. [52| 
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For u> < 2, V^(u) is calculated as 



and 



V ( (u) 



'1*ujA 



K 



exp 



4l*u 

.2 



K 



■ exp 



\/ttk(1 — u) 1 4l*LU 
B exp {-k(1 + u) + 1*uj} 
B exp {— k(1 ~ u) + 1*lu} 



(l + uf 



{l-uf 



(A9) 



The condition (A5) leads to the correlation length 



2Bk 2 u 2 



V(2H 



exp 



kI 



2 + uj 



(A10) 



and the renormolized potential at the equilibrium posi- 
tion u = 



V 6 (u) 



= 2B, 
u=0 \2B^a 



7 



w/(2+w) 

, exp 



2kI 



2 + uj 



These are the same as the previous ones .El 



(All) 



APPENDIX B: ELASTIC THEORY OF STRIPES 
WITH LONG-RANGE INTERACTIONS 

If we have a stripe structure of walls displaced slightly 
from equilibrium, then the additional potential energy is 



where 



(Bl) 



(B2) 



(il + u l {y i ),y l 



(B3) 



Here Ui(yi) denotes displacement at y — yi in ith wall. If 
the displacements are smalL-we can expand the energy 
in powers of u and obtair 



1 



AE = o E n ( r *' r X r *M r 



(B4) 



where u(r^) = Ui(yi). We can Fourier transform (B4) to 
obtain 



az: = TT -L_ I -$ T n(p)| u ( P )| 2 (B5) 



2(lay J (2tt) 



and 



n(p) = la]hxi— T V 



d 2 exp(-ip x r x ) 



2- 3/2 r((,-i)/2) 

V2,q-2Px> 1 > z -. 



(q-2)r(q/2yi"- 



(B6) 

9> 2, 

(B7) 



9 = 2 

C2\px\, q = l 

for small p^, where c\ and C2 are positive constants. On 
the other hand, in the elastic theory, potential energy is 
written as 



AE = — 



2 J (2tt) 2 



bx| 2 |u(p) 



(B8) 



Thus if the exponent satisfies q > 2, we can describe 
excitations with the elastic theory of Gaussian forms and, 
if q < 2, we cannot because K x diverges. 
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